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DETAILED ACTION 

Claims 1-33 are pending in this application. Claims 1, 25 and 28 are independent claims. 
The present title of the invention is "Apparatus and Method for Simulating Sensor Imagery". 
This action is non-final. 

The Group Art Unit of the Examiner case is now 2676. Please use the proper Art Unit number to 
help us serve you better. 

Claim Rejections - 35 USC § 102 

1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

2. Claims 1-13 and 15-18 are rejected under 35 U.S.C. 102(b) as being anticipated by Hsu 
(US 5,640,468). 

3. Regarding claim 1, Hsu discloses a method for identifying objects and features in an 
image comprising: 

A system for simulating a display of values of a data variable in a field of view (lines 42- 
46 of column 18, lines 1-30 of column 23 and lines 16-20 of column 25 and Fig. 6 and 9; while 
claim recites field of view, it is noted that the scene image represents a FLIR image and is being 
taken from a certain viewpoint. Also the height/depth of the object corresponds to the values of 
a data variable); 

An image generator comprising a computer having an output and transmitting thereon a 
video signal comprising at least two digital data channels (lines 2-13 of column 4 and Fig. 8b; it 
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is noted that the GIS comprises computer hardware to generate image. Also, the output video 
signal from the image generator is separated into 3 bands of data, see elements 122, 124 and 126 
of Fig. 6 and 8b); 

A display system connected with the output of the image generator and receiving said 
channels of digital data therefrom (lines 2-13 of column 4 and Fig. 6 and 8b; the display system 
Fig. 6b connects to the input image data (image being generated by input device), and receives 
image data from GIS processing unit which comprises the channels of data from Fig. 8b); said 
display system including a combiner circuit receiving and processing the channels of data 
(element 136 of Fig. 8b; while claim recites a combiner circuit, the term is broad enough to 
include the integration processor which combines the channels of data. It is noted that a 
processor in computer hardware can be considered as a circuit. Also, the output base and the 
processing components can be considered as a display system); 

Display system further having a visual display device connected with the combiner 
circuit and displaying video imagery derived from said video signal in a field of pixels for 
viewing by a user (lines 1-2 of column 8 and Fig. 6 and 8b; the output base (visual display 
device) is connected to the GIS processing which comprises the combiner (integrate) circuit and 
displays the pixel-based graphical image data to user); 

Digital data channels of the video signal from the image generator each comprising a 
plurality of bit sets each corresponding to a respective location in the field of view and having a 
preset number of bits of digital data therein (lines 41-49 of column 7, lines 52-56 of column 8 
and lines 16-20 of column 25 and Table I; it is noted that each segment region (location) of the 
scene image is being represented by the bands (channels) of video data which can have different 
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bit sets. While claim recites field of view, it is noted that the scene image can be a FLIR image, 
which is being generated from a viewpoint. Thus, the scene image can be considered as a field 
of view); 

The bit sets of the first channel each representing a respective value of the data variable at 
a first resolution, and the bit sets of the second channel each representing a respective value of 
the data variable at a second resolution higher than the first resolution (lines 41-49 of column 7 
and Table I; it is noted that each band (channel) of data can be assigned with different bit sets to 
create multi- level resolution image. Thus, a band of data will represent a resolution either higher 
or lower than the other bands of data depending on the bit sets values). 

4. Regarding claim 2, Hsu discloses a method for identifying objects and features in an 
image comprising: 

The video signal comprises three digital data channels, and the third digital data channel 
comprises a plurality of bit sets each corresponding to a respective location in the field of view 
and having a preset number of bits of digital data therein; the bit sets of the third channel each 
representing a respective value of the data variable at a third resolution that is higher than both 
said first and second resolutions (lines 41-49 of column 7, Table I and Fig. 8b; it is noted that 
each of the 3 bands (channel) of data can be assigned with different bit sets to create multi-level 
resolution image. Thus, a band of data will represent a resolution either higher or lower than the 
other bands of data depending on the bit sets values). 

5. Regarding claim 3, Hsu discloses a method for identifying objects and features in an 
image comprising: 
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The three channels are the red, green and blue data channels of a video output of the 
image generator (lines 41-49 of column 7 and Fig. 8b). 

6. Regarding claim 4, Hsu discloses a method for identifying objects and features in an 
image comprising: 

The resolution of each channel is determined by a respective range of corresponding 
values of the data variable being displayed (lines 34-51 of column 6, 41-49 of column 7, lines 
52-56 of column 8 and lines 47-52 of column 23 and Table I; it is noted that each segment region 
has different values of data variable (object height or depth) and is being represented by different 
bit sets of the bands (channels) of data to have different resolutions. 

7. Regarding claim 5, Hsu discloses a method for identifying objects and features in an 
image comprising: 

The image generator transmits scale values defining said ranges to the display system 
(lines 59-67 of column 7 and lines 1-13 of column 8 and Fig. 8b; while claim recites scale 
values, the term is broad enough to include the compression factor which is being used to 
defined the bits sets to represent the ranges of values of the regions to the display system). 

8. Regarding claim 6, Hsu discloses a method for identifying objects and features in an 
image comprising: 

The image generator calculates values of the data variable for the locations of the field of 
view (lines 1-30 of column 23 and Fig. 6 and 8Q while claim recites image generator calculates 
the values, it is noted that the system which produce the image in Fig. 6 comprises the GIS 
processing which is used to measure the height and depth (values of data variable) of objects in 
an image with certain viewpoint). 
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9. Regarding claim 7, Hsu discloses a method for identifying objects and features in an 
image comprising: 

After calculation of the values of the data variable, each of the values are stored in two 
respective data fields in computer accessible memory of the image generator, said data fields 
each being part of a respective area storing values of the data variable at respective resolutions, 
the associated value being scaled by respective scaling parameters for the respective resolutions 
(lines 34-39 of column 6 and Fig. 6; it is noted that objects with different edge values (values of 
data variable) have different corresponding resolution and the system has a data storage (element 
14 of Fig. 6) for storing those values). 

10. Regarding claim 8, Hsu discloses a method for identifying objects and features in an 
image comprising: 

The image processor performs additional calculations on said stored values in the scaled 
form to simulate aspects of viewing of the field of view based on stored parameters defining 
conditions of viewing (lines 40-55 of column 6 and lines 24-30 of column 23 and Fig. 6; it is 
noted that the image processing further utilize the feature values of object to generate regions in 
an object model which is depended on viewpoint. It is also noted that the system includes a data 
storage (element 14 of Fig. 6) to store the data needed for image processing). 

11. Regarding claim 9, Hsu discloses a method for identifying objects and features in an 
image comprising: 

The image generator calculates values of the data variable by determining from scene 
data stored therein a parameter of a simulated object that is sensed through one of said locations 
in the field of view and determining the value of the data variable to be displayed for said 
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location in the field of view based on said parameter (lines 6-37 of column 23 and Fig. 6 and 8b; 
it is noted that the system (Fig. 6; corresponds to image generator) receives sensed images 
(LADAR images or FLIR images) from particular viewpoint and determines the height/depth of 
the object to be displayed as a simulated image of the scene of the viewpoint) 

12. Regarding claim 10, Hsu discloses a method for identifying objects and features in an 
image comprising: 

The image generator calculates the values using a mathematical model of radiance of 
simulated objects that are determined to be in view in the field of view (lines 55-57 of column 3, 
lines 27-30 of column 4, lines 38-46 of column 18 and lines 6-37 of column 23 and Fig. 6 and 
8b; the system uses mathematical model to calculate object data such as height in the simulated 
scene images from a certain viewpoint. Also, while claim recites radiance of object, it is noted 
that the images are LADAR images which utilizes laser radar to sense objects to construct 
images. Thus, by using the mathematical model on the laser radar detected data of the object, it 
is functioning the same). 

13. Regarding claim 1 1 , Hsu discloses a method for identifying objects and features in an 
image comprising: 

The locations of the field of view each correspond to a respective pixel of the display 
device (lines 48-51 of column 6 and lines 24-30 of column 23; each region of the model in 
certain viewpoint corresponds to the individual pixels of the region). 

14. Regarding claim 12, statements presented above, with respect to claim 1 are incorporated 
herein. There is no new limitation. 
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15. Regarding claim 13, Hsu discloses a method for identifying objects and features in an 
image comprising: 

The data variable is simulated infrared sensor data generated by the image generator 
(lines 38-46 of column 18 and lines 6-37 of column 23 and Fig. 6\ it is noted that the height data 
of object in the FLIR images can be considered as simulated infrared sensor data). 

16. Regarding claim 15, Hsu discloses a method for identifying objects and features in an 
image comprising: 

The bit sets are each a set of eight bits (lines 41-49 of column 7; noted that the example 
of bit set given is eight bits). 

17. Regarding claim 16, Hsu discloses a method for identifying objects and features in an 
image comprising: 

The combiner circuit has scale parameters for each of the channels and derives for each 
bit set a scaled value of the data variable (lines 41-37 of column 7 and lines 6-15 of column 23 
and Table I; while claim recites combiner circuit, it is noted that the system has the component to 
combine the data from each channel derive compression factor (scale value) to generate 
composite images with data value of objects). 

18. Regarding claim 17, Hsu discloses a method for identifying objects and features in an 
image comprising: 

The scale parameters for each channel are transmitted from the image generator to the 
combiner circuitry with each new screen of the video signal (lines 41-67 of column 7 and Fig. 6 
and 8b; while claim recites each new screen of the video signal, it is noted that the process of 
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Fig. 8b is for a single scene or a screen of the video signal. Thus, each new scene will go 
through the image process). 

19. Regarding claim 18, Hsu discloses a method for identifying objects and features in an 
image comprising: 

The scale parameters each include a value defining a size of a range of data values in the 
channel, or minimum and maximum values of the range (lines 6-13 of column 8 and Table I; 
table I shows minimum and maximum value range). 

Claim Rejections - 35 USC § 103 

20. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

21. Claim 14 is rejected under 35 U.S.C. 103(a) as being unpatentable over Hsu (US 
5,640,468) as applied to claim 1 above, and further in view of Wilson et al. (US 3,742,124; refer 
to as Wilson herein). 

22. Regarding claim 14, Hsu discloses a method for identifying objects and features in an 
image comprising: 

Each of the channels transmits values of the data variable that are for a respective range 
of infra-red temperatures, the ranges each having a respective midpoint temperature, for the 
simulation being presented to the user (lines 35-46 of column 5 and lines 1-5 of column 8; it is 
noted that each color (channel values) corresponds to a wavelength intervals that correspond to a 
different range of temperatures using the radiation. This is also shown by Wilson (see Fig. 3). 
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And while claim recites midpoint temperature, it is noted that any range of temperature will have 
a midpoint, thus each range represented by different colors will have a midpoint temperature). 

Hsu does not disclose that midpoint temperatures being an ambient temperature. Wilson 
disclose a color infrared detecting set that utilize the method (lines 32-49 of column 4 and Fig. 3; 
it is noted that the ambient temperature 1 10 degree is midpoint of the wavelength range). It 
would have been obvious to one of ordinary skill in the art to utilize the teaching of Wilson to 
provide an improved infrared detecting set by using more detailed analyses of imagery (lines 64- 
65 of column 1 and lines 14-17 of column 2, Wilson). Also, both Hsu and Wilson are directed 
to method of infrared detecting and image analysis. 

23. Claim 19 is rejected under 35 U.S.C. 103(a) as being unpatentable over Hsu (US 
5,640,468) as applied to claim 1 above, and further in view of Tanaka (US 6,154,252). 

24. Regarding claim 19, Hsu discloses a method for identifying objects and features in an 
image comprising: 

The scale parameters for different ranges of data values between the channels (lines 40- 
67 of column 7). Hsu does not disclose a respective offset. Tanaka discloses an image device 
for use as radiation detector utilizing the method (lines 18-34 of column 8). It would have been 
obvious to one of ordinary skill in the art to utilize the teaching of Tanaka to provide optimum 
processing conditions for low and high illuminance areas (lines 47-53 of column 2, Tanaka). 
Also, both Hsu and Tanaka are directed to method of utilizing color signals for display radiation 
detected images. 


Application/Control Number: 10/080,91 1 Page 1 1 

Art Unit: 2676 

25. Claims 22-23 are rejected under 35 U.S.C. 103(a) as being unpatentable over Hsu (US 
5,640,468) as applied to claim 1 above, and further in view of Warner et al. (US 6,255,650; refer 
to as Warner herein). 

26. Regarding claims 22 and 23, Hsu discloses a method for identifying objects and features 
in an image comprising: 

The visual display device is a monitor screen (lines 50-51 of column 7). Hsu does not 
disclose the display device is a head mounted display or a monochrome monitor. Warner 
discloses a device for extreme temperature radiometry and imaging utilizing the display devices 
(lines 9-14 of column 10 and Fig. 1A-B). It would have been obvious to one of ordinary skill in 
the art to utilize the teaching of Warner to provide the advantage of better visualization of image 
by presenting background images in gray-scale and emphasize particular interest in color and 
also providing the user with portability to better operation of the device (lines 62-67 of column 1 
and lines 14-16 of column 10, Warner). 

27. Claim 24 is rejected under 35 U.S.C. 103(a) as being unpatentable over Hsu (US 
5,640,468) as applied to claim 1 above, and further in view of Cooper (US 3,786,269). 

28. Regarding claim 24, Hsu does not disclose a gain control simulation device adapted to be 
operated by the user, said gain control simulation device communicating with the display system 
so as to simulate therein adjustment of gain by the user. Cooper discloses a method for scanning 
electromagnetic radiation utilizing the method (lines 20-27 of column 10). It would have been 
obvious to one of ordinary skill in the art to utilize the teaching of Cooper to provide better 
contrast for the display. Also, both Hsu and Cooper are directed to using infrared radiation to 
detect scene in interested. 
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Allowable Subject Matter 


29. Claims 20-21 are objected to as being dependent upon a rejected base claim, but would 
be allowable if rewritten in independent form including all of the limitations of the base claim 
and any intervening claims. 

30. Claims 25-33 are allowed. 

31. The following is a statement of reasons for the indication of allowable subject matter: 
Regarding independent claim 25, prior art references do not anticipate or suggest the 

limitation "said combiner circuit selecting as a selected scaled value for the pixel the scaled 
value from the first channel if all three scaled values for the pixel are different, selecting as the 
selected scaled value for the pixel the scaled value of the second channel if the scaled value of 
the second channel is equal to the scaled value of the first channel but different from scaled value 
of the third channel, and selecting as the selected scaled value for the pixel the scaled value of 
the third channel if all the scaled values for the pixel are different" in combination with the other 
claim limitations. 

Regarding independent claim 28, prior art references do not anticipate or suggest the 
limitation "scaling the scaled data values to a common scale that allows comparison of values 
from one channel to values from the other channel, selecting a value from said data values on the 
common scale based on an assessment of the data being less likely to have been clamped in 
value by a range of a channel" in combination with the other claim limitations. 


32. The prior art made of record and not relied upon is considered pertinent to applicants 
disclosure. 


Conclusion 
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Massofet al. (US 6,529,331); 


Beckwith Jr. et al (US 5,140,532). 


Inquiry 


Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Po-Wei (Dennis) Chen whose telephone number is (703) 305- 
8365. The examiner can normally be reached on 9am-5pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Matthew C Bella can be reached on (703) 308-6829. The fax phone number for the 
organization where this application or proceeding is assigned is (703) 872-9306. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is (703) 305-3900. 


Po-Wei (Dennis) Chen 

Examiner 

Art Unit 2676 


Po-Wei (Dennis) Chen 
December 4, 2003 
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SUPERVISORY PATENT EXAMINER 
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